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stability  Analysis  of  Cohesion  Properties  of 
Cooperative  Agents  with  Limited  Sensor  Capability* 

Yanfei  Liu  and  Kevin  M.  Passino  ^ 

Dept  Electrical  Engineering 
The  Ohio  State  University 
2015  Neil  Avenue,  Columbus,  Ohio  43210 


Abstract 

Networked  unmanned  aerial  vehicles  (UAVs)  are  being  developed  for  various  applications.  Multiple 
robots  can  be  designed  to  coordinate  to  accomplish  certain  tasks.  Their  cooperative  behaviors  resemble, 
to  a  certain  extent,  those  of  bacteria,  bees  and  birds  that  work  together  for  food  in  the  biological 
world.  Suppose  that  we  refer  to  all  such  groups  of  entities  as  “social  foraging  swarms.”  In  order  for 
such  multi-agent  systems  to  succeed  it  is  often  critical  that  they  can  both  maintain  cohesive  behaviors 
and  appropriately  respond  to  environmental  stimuli.  In  this  paper  we  derive  stability  conditions  under 
which  social  foraging  swarms  with  limited  sensing  capability  maintain  cohesiveness  when  following  certain 
resource  profiles.  The  results  are  verified  with  simulations  and  challenge  us  to  look  for  some  connections 
between  swarms  with  limited  sensing  capability,  noisy  measurements,  and  changes  of  communication 
topology. 


1  Introduction 

Swarming  has  been  studied  extensively  in  biology  [1,  2]  and  engineering  applications  including  “intelligent 
vehicle  highway  systems,”  formation  control  for  robots,  aircraft,  and  cooperative  control  for  uninhabited 
autonomous  (air)  vehicles,  etc.  [3,  4,  5,  6].  Early  work  on  swarm  stability  is  in  [7,  8].  Some  lately  work 
includes  [9,  10,  11),  where  the  authors  also  consider  asynchronous  and  time  delays.  Some  previous  work 
studies  swarms  that  perform  social  foraging  (i.e.,  follow  certain  resource  profiles  while  achieving  cohesiveness) 
(12,  13,  14,  15,  16).  Due  to  the  limited  sensing  capability  of  the  agents  or  broken  communication  network, 
changes  on  communication  topology  of  the  swarm  agents  may  happen  and  affect  the  system  stability.  Some 
work  on  the  topology  changes  in  multi-agents  includes  [17,  18],  where  the  authors  study  the  convergence  of 
the  system  based  on  graph  theory. 

In  this  paper,  we  continue  some  of  our  earlier  work  on  studying  stability  properties  of  foraging  swarms 
in  [19,  20).  The  main  difference  with  our  previous  work  is  that  here  we  consider  the  effect  of  the  swarm 
agents  with  limited  sensing  capability.  Thus,  we  are  actually  dealing  with,  to  a  certain  extent,  a  dynamically 
changing  network  topology.  Although  it  is  not  a  fully  switching  network,  the  firamework  allows  us  to  get 
some  progress.  Here,  a  fully  switching  network  is  approximated  by  adopting  an  appropriate  sensor  profile 
in  our  framework.  We  are  able  to  obtain  some  local  results  which  show  an  explicit  relationship  between  the 
sensor  profile  and  the  initial  condition  of  the  system  such  that  stable  social  foraging  swarms  may  be  achieved. 
In  comparison,  the  authors  in  [18]  deal  with  a  fully  switching  network,  but  to  obtain  some  stability  results, 
they  need  to  assume  there  exists  an  infinite  sequence  of  contiguous,  non-empty,  bounded  time  intervals  such 
that  all  the  agents  are  linked  together  during  each  such  interval.  Such  assumption  may  be  difficult  to  verify, 
especially  for  a  biological  system. 

The  remainder  of  this  paper  is  organized  as  follows:  In  Section  2  we  introduce  a  basic  model  for  agents, 
interactions,  and  the  foraging  environment.  Then,  a  model  for  sensor  profile,  control,  and  error  dynamics 

*This  work  was  supported  hy  the  DARPA  MICA  Program,  via  the  Air  Force  Research  Laboratory  under  Contract  No. 
F33615-01-a3151. 

^Please  address  all  correspondence  to  K.  Passino,  (614-292-5716);  passino6ee.eng.ohio-state.edu 
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is  introduced.  Section  3  holds  the  main  results  on  stabilily  analysis  of  swarm  cohesion.  Section  4  holds  the 
simulation  results  and  some  concluding  remarks  are  provided  in  Section  5. 


2  Models  for  the  Cooperative  Social  Foraging  Swarms 


2.1  Basic  Model  for  Agents,  Interactions  and  Environment 

Consider  a  swarm  composed  of  an  interconnection  of  N  “agents,”  each  of  which  has  point  mass  dynamics 
given  by 


X  =  V 


Mi 


(1) 


where  re*  G  3?”  is  the  position,  v*  G  3?”  is  the  velocity,  Mi  is  the  mass,  and  w*  G  Sf’'  is  the  (force)  control 
input  for  the  agent. 

Agent  to  agent  interactions  considered  here  are  of  the  “attract-repel”  type  where  each  agent  seeks  to  be 
in  a  position  that  is  “comfortable”  relative  to  its  neighbors  (and  for  us  all  other  agents  are  its  neighbors). 
Attraction  indicates  that  each  agent  wants  to  be  close  to  every  other  agent  and  it  provides  the  mechanism 
for  achieving  grouping  and  cohesion  of  the  group  of  agents.  Repulsion  provides  the  mechanism  where  each 
agent  does  not  want  to  be  too  close  to  any  other  agent  (e.g.,  for  animals  to  avoid  collisions  and  excessive 
competition  for  resources).  Attraction  here  will  be  represented  in  in  a  form  like  — fc  (rr*  —  rc^)  where  fc  >  0 
is  a  scalar  that  represents  the  strength  of  attraction.  For  repulsion,  we  adopt  2-norm  and  use  a  repulsion 
term  in  u*  of  the  form 

/  lii_t 

(2) 


where  kr>0  and  r,  >  0.  Other  types  of  attraction  and  repulsion  terms  are  also  possible. 

For  the  environment  that  the  agents  move  in,  we  will  simply  consider  the  case  where  they  move  over  a 
“resource  profile”  J(x)  where  x  G  3i”.  Agents  move  in  the  direction  of  the  negative  gradient  of  J{x)  (i.e., 
in  the  direction  of  —VJ(x)  =  —§§)  in  order  to  move  away  from  “bad”  areas  and  into  “good”  areas  of  the 
environment.  We  will  assume  that  resource  profile  J(x)  is  any  profile  that  is  continuous  with  finite  slope  at 
all  points. 


2.2  Model  for  Sensor  Profile,  Control  and  Error  Dynamics 

Let  X  =  ^  centroid  position  and  velocity  of  the  swarm,  respectively. 

To  study  the  stability  of  swarm  cohesion  we  study  the  dynamics  of  an  error  system  with  c*  =  a:*  —  x  and 

ei  =  v*-v.LetE*=  [e* ei"^]  and  E  =  [E^'^ ,  ,■■■,  E’^'^]  .  We  have 

x*-x^  =  {x*-x)-{aP -x)=ei,-e>p 
V*  —  =  (v*  —  v)  —  (t;^  —  v)  =  e*  —  ej 

Define  some  short-hand  notation  as  x*^  =  x*  —  =  v*  —  ei?  =  e*  —  ej,  el/  =  e*  —  c/.  The  error 

dynamics  are  ^ven  by 


N 


1  i  1^1,* 

Mi"  ^ 

1=1 


(3) 


Assume  each  agent  has  range-linuted  sensing  capability.  To  represent  this,  define  a  mOnotonically  de¬ 
creasing  function  /(x) :  3?"^  (0, 1]  as  the  “sensor  profile”  such  that  limar-.+o+  /(x)  =  1  and  limx-^oo  f(^)  =  0- 

A  candidate  function  that  satisfies  these  requirements  is  a  Gaussian-shaped  function  centered  at  zero  or 

f(x)  =  arctan(c/i (x  -  c/2))  4-  ^  (4) 

TT  Z 


2 


where  c/o  is  a  normalization  factor  and  c/i  and  c/2  may  be  adjusted  to  obtain  different  sensing  range  profiles. 
This  function  is  shown  in  Figure  1  for  one  set  of  parameters. 


Figure  1:  Sensor  profile  f{x). 


Let  N*{t)  =  /  (11^*-' II)  for  all  t  =  1, . . . , iV.  By  definition  1  <  <  N  and  N*  may  or  may  not  be 

an  integer.  Define  for  each  agent  i 


i=l 


which  we  view  as  swarm  position  and  velocity  centers  from  the  perspective  of  agent  i.  From  the  equations 
above,  the  position  and  velocity  of  agent  i  relative  to  x*  and  v*  are 


E  /  i¥^\)  E^'  E-^ 

i=i  i=i  i=i . 


(5) 


and  similarly  for  ej,.  The  variable  cj,  is  the  vector  of  displacements  between  the  position  of  agent  i  and 
the  center  of  all  its  neighbors  where  the  notion  of  “neighbor”  is  specified  via  the  sensor  profile.  We  do  not 
assume  that  and  hence  (e* )  can  be  sensed  perfectly.  In  particular,  let  d*J  G  S”  and  d^J  €  3?” 

be  sensing  errors.  Let  x*^  =  and  —  d^J,  Define  iV*(t)  =  (||^*^  ||)’  assume 

dj*  =  djf  =  0  for  all  t,  so  we  have  1  <  N*  <  N,  If  in  Equation  (5)  we  replace  x*^  (v*^)  with  x*^  (v*^)  we  get 


4  =  5;  E  /  (P"  ID  -  5:  E  /  (ll*"ll)  (4'  -  <0  =  4  -  E  /  (||*« 


I  eL  “  it 


(6) 


with  4  =  IF  EjLi  /  (||^*^  jl)  4^*  Similarly  we  obtain  with  4  =  }F  SjLi  /  (ll^'^il)  Alternatively, 
we  could  also  define  4  ”  4  “  4  same  t3rpe  of  results  as  below.  Here,  we  assume  that  we  can 

measure  4 

We  assume  the  resource  profile  is  continuous  with  finite  slope  at  all  points,  i.e.,  ||VJ(a;(t))||  <  R,  where  R 
is  a  known  constant.  Also  assume  the  agent  senses  VJ  (a:*(f)),  the  gradient  of  the  profile  at  its  position, 
but  also  with  some  error  dj  G  That  is,  each  agent  i  senses  V J  (a:*(t))  —  4'  simplicity,  we  will  write 
VJ  (a:*(t))  as  VJ*  from  now  on. 

For  all  the  noise  mentioned  above,  we  assume  they  are  sufficiently  smooth  and  bounded  by  some  constants. 
Specifically,  we  assume 


\m<D, 

Ill'll  <  D,  (7) 

¥f\\<Df 
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where  Dp  >  0,  Dv  >  0  and  Df  >0  aie  known  constants.  Note  that  |<^||  <  ^  (||®*^||)  ||‘^^||  ~ 

and  similarly,  <  D„. 

Now  suppose  the  general  form  of  the  control  input  for  each  agent  is 


=  -Mikpei,-Mihe\,-Mikv\-MikfVJ^ 
\  ®  / 


(8) 


where  the  scalars  kp>0  and  A:^  >  0  indicate  how  aggressive  each  agent  is  in  aggregating,  fc  >  0  works  as  a 
“velocity  damping  gain,”  kr>0  sets  how  much  that  agent  wants  to  be  away  from  others,  >  0  represents  its 
repulsion  range,  and  k/  >0  indicates  that  agent’s  desire  to  move  along  the  negative  gradient  of  the  resource 
profile,  lb  use  Equation  (8)  as  our  control  we  assume  that  each  agent  knows  its  own  velocity  v*,  and  e*  and 
ej,  as  discussed  above.  Also  we  assume  that  agent  i  can  sense  /(||x*J  for  all  j  ^  i,  j  =  1, . . . ,  We 
think  of  as  a  noisy  range-limited  measurement  of  In  summary,  in  all  cases  each  agent  i  only 

needs  noisy  range-limited  sensing  for  its  “decision  making”  via  Equation  (8). 

Next,  we  derive  the  error  system  of  which  we  will  study  stability  properties.  Let 


N 

r‘=  53  exp 


FVom  Equations  (6)  and  (8)  we  have 

v*  =  4r^*  =  -kpel-k„e[-kv*-kf{VJ^-(Pj)  +  krTy 

Mi 


•  N 


=  -*p4  +  -fe  I:  /  ID  4  -  ^4  +  4  E  /  (II**'  ID  4  -  -  */V  J’- 

^  j=l  i=l 

+krT'  +  kp^p  +  +  kfd^f 


-  -Vi + ^  E  (1  -  (11^®''  ID)  4  -  ‘."t + ^  E  (1  -  A/  (\W‘  ID)  4  -  *»■  - 1, vj* 


TV 


+krT^  +  kp^p  +  k„^„  +  kfiTf 


-  -Vi-'feEA/(ll-‘'ID4-v‘.-4EA/(ll*“ID4-t»‘-‘/Vj‘ 

^  j=l  i=l 

+krT*  +  kp^p  -1-  k„^„  +  kfdj 

1  AT 

=  -kpe*p  -k„ei-4rY,^f  ID  ((*P.  *«-)  -kv*-kfVJ^  +  +  fc/4 

i=t 


where  A/  (||®‘^||)  =  1  -  /  (||®*^  ||)  ^  0  (recall  0  <  f(x)  <  1).  To  obtain  the  above  expression,  we  used  the 
facts  that  =  0  and  e«  =  0.  Then 


^  E  ^  E  -*p4  -  E  (P‘dl)  ([*p  *•>)  -  */ 


-^kpT*  kp^  -|-  kv^  -f  kfdj 


N 


-  -if  j: 


i=l 


TV 


]^E^/(II**'ID(1^pM^^') 


i=i 


—  kv  —  kfR  -f  krf  +  kpdp  +  kydy  +  k/df  (9) 


4 


4  =  «<  -  €  =  -fcpe‘  -  (K  +  k)ei  -  4  E  (11*'^  ID  ((*P  **>] 


^Sti 


J=1  i=l 


-Jfc/(VJ‘-5)+jfer(T‘-f) 


~\-kp  -f*  kxj  d^^  +  kf  (djr  —  df^ 


=  -kpel-^{k^  +  k)el  +  6\E)-^<t>* 


(10) 


where 


N 


i=i 


"  -:|rE^/(ll*‘1l)(fe‘.l®')+^E 

i=i  1=1 

<l>  =  —A;/  (V J*  —  -R)  +  fcr  (t*  —  f)  4-  Ajp  +  k^  +  kf  (djr  ~  d/) 

With  /  an  n  X  n  identity  matrix,  the  error  dynamics  of  the  agent  may  be  written  as 


Note  that  any  matrix 


[0  7  ] 

-fell  -kil  J 


(11) 


with  A?!  >  0,  A:2  >  0  has  eigenvalues  given  by  the  roots  of  (s^  +  k2S  4-  A;i)”,  which  are  in  the  strict  left  half 
plane.  Thus,  the  matrix  A  above  is  Hurwitz  with  Arp  >  0,  Aj^  >  0  and  A;  >  0. 

3  Stability  Analysis  of  Cohesive  Socicd  Foraging 

To  study  the  stability  of  the  error  dynamics,  it  is  convenient  to  choose  Lyapunov  function  for  each  agent 

Vi  (E^)  =  (12) 

with  P  =  P^  a  2n  X  2n  matrix  and  P  >  0  (a  positive  definite  matrix).  Then  we  have 

Vi  =  {PA  +  A'^P)  ET  +  2E^^PB  {P{E)  +  (/>*)  (13) 

-Q 

Note  that  when  Q  =  Q'''  and  Q  >  0,  the  unique  solution  P  of  Pyl  +  .4'''P  =  -Q  has  P  =  P'''  and  P  >  0  as 
needed. 


Choose  for  the  composite  system 


N 


V{E)  =  Y,Vi{W) 


»=:1 


where  Vj  {0)  is  given  in  Equation  (12).  Then  we  have 


E  (^m,n(P)  ||P‘||")  <  V{E)  <  (XmasiP)  ) 

i=l  t=l 


(14) 


For  now,  assume  j^A/  (||®*^  ||)  Jfev]||  <  «  for  any  t  and  j  at  any  t,  with  a  some  constant  to  be  determined. 
Apparently,  the  smaller 

the  smaller  5  can  be.  In  fact,  d  reaches  its  minimum  of  0  when  A/  ||)  =  0  for  aU  *  and  j.  Then  we  have 


It  is  seen  that  the  function  F(^)  =  exp  ll^ll,  with  i>  any  real  vector,  has  a  unique  maximum 

value  of  exp(-5)ra  which  is  achieved  when  HV’H  =  r,.  Also  /(x)  <  1  for  any  x  >  0.  So  ||r’||  <  exp(-5)r, 
and  thus,  ||t’  -f||  <  2exp(-|)r,.  Note  ||^-<^||  <  2Dp.  Similarly,  ||<^  -^||  <  2D„  and  ||djr  -J/||  <  2Df, 
Also  II VJ*  -  .K||  <  2R.  Then  for  all  i  we  have  Tt  such  that 

||^‘  II  <  i-T  =  +  2jfer  exp  r,  +  2kpDp  +  2kyD„  +  2kfDf  (16) 

Using  the  above  equations  and  the  fact  that  \\B\\  =  1  we  have 


nE)  = 


< 


< 


^  ^  r  -r  T  T 

Vi{E*)  =  Y  +  2E^  PBXS^{E)  +  ^‘)J 

1=1  i=l  *■ 

f;  [-A.»..(e)  ll^-f  +  2  lfB‘11  A™.(P)  (||i'(B)||  +  llif'll)] 

t=l 


N 


mY 


1=1 


(17) 


The  equation  above  indicates  that  smaller  value  of  is  desirable  for  achieving  stability.  Note  that  the 

fraction  is  minimized  by  choosing  Q  =  J,  thus,  we  replace  it  with  Pm  =  ~  ^max{P\Q=i)y  where 

the  explicit  form  of  Pm  niay  be  obtained  by  solving  the  Lyapimov  equation  A^P  +  PA  =  —I  and  we  have 


jO  _  d"  d-  {ky  -f  k)^  I  +  ife)^  1\ 

2kj,{k^  +  k)  ■*‘VV  +  J  k^ 


So  Equation  (17)  now  is  written  as 

N 


nE)  < 

t=i 

N 

=  E 


N 


ll^‘lr  +  ll^^ll  E^^wa  \m-\r^Mrr  ll^^ll 

i=i 


N 


ll^f +  c||£:‘||  +  ||e*||E(«I|s^II) 

i=i 


with  c  =■  Pm'^'t  and  a  =  2/?Afa  are  positive  constants.  Note  that  for  any  0  <  ^  <  1, 

-ii^ir+ Hit’ll  =  +Hi^ii 

<  -(l-0)||£‘f  ,VM>r 

=  -mf 


(18) 


(19) 


(20) 
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where  r  =  |  and  a  =  -(1  —  6)  <  0.  This  implies  that  as  long  as  ||E*||  >  r,  the  first  two  terms  in  (19) 
combined  will  give  a  negative  contribution  to  V (E). 

Next,  we  seek  conditions  under  which  V{E)  <  0.  To  do  this,  we  consider  the  third  term  in  (19)  and 
combine  it  with  the  above  results.  Consider  the  general  situation  where  some  of  the  E*  are  such  that  ||  <  r 
and  others  are  not.  Define  sets 

no  =  {i:||E‘||>r,  = 

and 

where  No  and  Nj  are  the  size  of  IIo  and  II/,  respectively.  Also,  IIo  IJnj  =  {1, . .  • ,  and  Ho  flU/  = 

Of  course,  we  do  not  know  the  explicit  sets  Do  and  11/;  aU  we  know  is  that  they  exist.  The  explicit  values 
in  the  sets  clearly  depend  on  time  but  we  will  allow  that  time  to  be  arbitrary  so  the  analysis  below  will  be 
for  all  t  Obviously  the  system  may  switch  back  and  forth  between  the  cases  of  No  =  0  and  No  >  0.  But 
note  that  after  the  system  has  switched  to  No  =  0  at  certain  moment,  if  it  persists  there,  then  the  system 
is  bounded,  with  \\E^\\  <  r  for  all  t.  ff  otherwise,  then  No  >  0  will  happen.  So  firom  now  on,  we  assume 

No  >  0  (but  not  necessarily  persists  there),  that  is,  the  set  Ho  is  non-empty.  Then  using  analjrsis  ideas 

from  the  theory  of  stability  of  interconnected  systems  [21]  and  using  Equations  (19)  and  (20),  we  have 

ieiio  ieiio  y  j'eiio  J  ieiio  y  /eii/ 

E'(-l|B*r +o||^ll)  +  E  (“Ill'll  E  Ill'll)  +  E  fp'll  E  oils'll ) 

♦erij  ieri/  y  ieno  /  ten/  y  j^Jii  j 

Note  for  each  fixed  iVo,  with  the  corresponding  Ni—N  —  No  we  can  find  constants  Ki{Nj),  K^iNi)  and 
Nz(Ni)  such  that 

Ki{Nj)  > 

K2{Nj)  > 

Kz{Ni)  > 

In  fact,  the  equations  above  are  satisfied  by  choosing 


Then,  we  have 

He)  <  E^M’+E 

iello  ieHo 

=  E-rr+E 

ieHo  i£Tlo 


KiiNi) 

K2{Ni) 

Ksm 


=  Njar 
— 

^  Pm^t 
=  NjV^a 


(22) 


^  jeOo  J  teHo  ieHo 

ll^^ll  E  +2ifi  E  \M+k2+k2 

jen©  J  tcHo 


E»M=E“II«‘II 

ieit/  ten/ 

E  (-rf  H-cIPIl) 

ieiij 

EfniEMWI 

»en,  \  ien/ 


(21) 
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Let  ||,  \\E^°  ,  \\E^o°  ||]  (the  composition  of  this  vector  can  be  diflFerent  at  diflferent  times) 

and  the  No  x  No  matrix  S  =  [5jn]  be  specified  by 


_f-(<r  +  o),  j  =  n 
\  -a,  j^n 


(23) 


so  we  have 

V{E)  <  -w'^Sw  +  2Ki  ^  ||£:‘  \\+K2  +  Ks 

i^Uo 

It  can  be  proven  that  the  eigenvalues  of  matrix  S  include  one  at  —  (o-  +  Nqo)  and  No  —  1  repeated  value  of 
-tr.  Since  a  >  0,  we  have  Ami„(S)  =  -  (<r  +  Noo).  Assume  o  <  then  it  is  guaranteed  that  a  < 
and  thus,  XminiS)  >  0,  so  we  have 

V{E)  <  -A,„.„(5)  X)  ||i^f  +  2ii:i  X)  11^^11  + ^2  + ifs 

t€no  *eno 

<  (n  +  Noa)  Y,  11^11*  +  +  if2  +  ifs 


i^Uo 


ieuo 


=  (<T  +  Noo)  Eo^  "f  y/ NoEo  +  N2  +  Kz 


(24) 


where  Eo  =  y/Ylieno  11^^ Above  we  used  the  fact  that  given  n  real  numbers,  their  mean  value  is  smaller 
than  or  equal  to  their  rms  (root  of  mean  square)  value. 

Now  define  function 


Ni)  =  Ko{Ni)d^  +  2Ki{Ni)y/N-Nii»  -h  K2{Ni)  +  Kz{Ni) 


(25) 


with 


Ko{Ni)^a-\-{N-Ni)a  (26) 

and  Ki{Ni)  are  defined  in  Equation  (22)  for  i  ==  1,2,3.  Assume  is  the  maximum  root  of  F{^,Ni)  =  0 
with  Nj  fixed.  Then  for  any  Nj^  we  have  F{d^Ni)  <  0  for  1?  >  Em  with  constant  Em  defined  as 

Em  =  max  t? 

0<Ni<N 

By  comparing  Equation  (24)  with  (25),  we  can  see  that  V{E)  <  0  whenever  Eq  ==  11-^  II  ^ 

From  the  definitions  of  Ho,  H/  and  r,  we  may  further  deduce  that  V{E)  <  0  whenever  ||^*||  > 
Elf^iN^iy,  Let 

E,  =  El^{N-iy^e  (27) 

where  e  is  an  arbitrarily  small  positive  number.  Also  let  Es  =  define  compact  set  Qb  = 

{Es  I  Es  <  Ee}^  Then  V{E)  <  0  on  dils  (the  boimdary  of  Qb)-  Note  that  on  dflB,  from  Equation  (14) 
and  (27)  we  have 


N 


N 


A„i„(P)X)  ll^^ir  <  ViE)  <  A„„.(P)5];  llP'f  =  I3mE, 

i=l  t=l 

Since  for  any  i  it  satisfies  that  ||^*|P  <  ll^lP’  have  Xmin{P)  ^  V{E)  <  PmEs  for  any  i, 

that  is, 


(28) 


where  =  Amin(P)  and  it  can  be  solved  that 

(jfcp  +  l)=^  +  (fe„  +  fe)^ 


13m  = 


2kp{kv  +  k) 


_  l(kl  +  {k.  +  kr-iy  1 

y  \  2kp{k„  +  k)  )  *2 
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Equation  (28)  gives  an  upper  bound  of  ||E*  ||  for  any  i  which  no  agent  could  go  beyond  if  the  system  starts 
initially  within  the  set  Qb* 

Finally,  recall  we  assumed  that  (||^*^  ||)  |l[A;p  fcvlil  <  «  for  any  i  and  j  at  any  f.  FVom  Equation  (28), 
this  is  justified  if  Es{0)  €  Qb  and  the  sensor  profile  f{x)  is  such  that 


+  - ■■ 

V  V 


(29) 


since  Af{x)  =  1  -  f{x),  a  =  2PMa  and  ||  <  ||f:‘||  +  ||E^' |(  +  jj  <  2 maXi  \\B^\\  + 

With  all  the  deductions  above,  we  collect  all  the  conditions  and  state  them  in  the  following  theorem. 

Theorem  !•  Consider  the  N-agent  error  system  described  by  the  model  in  Equation  (11)>  Assume  the 
resource  profile  is  continuous  with  finite  slope  at  all  points  such  that  ||VJ(x(f))||  <  jR.  Define  rr  =  2kfR  + 
kr  exp(-“|)r«  -f  2kpDp  +  2kvDv  +  2kfDf.  Let 


Bm  -  4-  (fc„  +  fe)^  J7 

2kj,iK  +  k) 


A:2  +  (fc„+fc)2-iy  1 


2kp(k„  +  k) 


) 


Also  let  0  be  some  constant  satisfies  0  <  0  <  1  and  r  =  Assume  there  exist  positive  constants 

a  <  and  Em  =  maxo<jV/<N'*^,  where  is  the  maximum  7Vot  of  function 


F{d,  Ni)  =  Ko{Ni)^^  +  2Ki{Ni)y/infid  +  K^iNi)  +  Kz{Ni) 


with 


KoiNi)  =  -{l-0)  +  iN-Ni)a 
Ki{Ni)  =  Niar 

K2{Ni)  =  ^BWr 
KsiNi)  =  Njr^a 
such  that  for  the  sensor  profile  we  have 


Na 


2BMy/kj  +  k^ 


with  Ee  =  Elf-h{N—l)r^’i-e  ande  an  arbitrarily  small  positive  number.  Define  Es{t)  =  ||i?*(t)||^  and 

set  ftn  =  {Es  I  Es  <  Ee}.  If  it  satisfies  Es{0)  €  then  the  trajectories  of  the  error  system  is  uniformly 

bounded  and  ||E*||  <  yJ^Ee  for  all  i  and  t. 

Remark.  This  theorem  gives  us  a  condition  on  the  sensor  profile  and  the  initial  condition  of  the  system  such 
that  the  system  trajectories  are  bounded.  If  the  agents  start  close  enough  to  each  other  and  the  sensor 
profile  is  “flat”  enough,  then  the  swarm  can  stay  cohesive  while  move  along  the  resource  profile.  The  results 
obtained  here  are  quite  conservative  since  we  have  to  over  boimd  many  nonlinear  terms  in  the  deduction. 

To  reduce  the  demand  to  the  “flat”  range  of  the  sensor,  smaller  Eg  is  desirable.  FVom  Equation  (27)  and 
(29)  we  can  see  that  smaller  kr  and  r,  are  helpful  since  that  means  agents  “push”  each  other  less.  Smaller 
kf  is  also  helpful  since  it  means  the  agents  may  get  distracted  less  by  environment  and  thus,  have  better 
chance  to  stay  cohesive.  A  “flat”  resource  profile,  meaning  smaller  Ry  also  helps  the  swarm  stay  cohesive. 

Although  at  the  beginning  of  the  paper  we  assume  all  the  agents  will  follow  the  same  resource  profile, 
in  fact  firom  the  deduction  of  the  theorem  we  can  see  that  the  result  also  holds  for  the  case  when  the  agents 
are  following  diiOFerent  profiles,  so  long  as  those  profiles  are  continuous  with  finite  slope  at  all  points.  For 
this  case,  the  preservation  of  cohesiveness  indicates  that  due  to  the  desire  to  stay  together,  the  agents  each 
sacrifice  following  their  own  profile  and  compromise  to  follow  certain  “averaged”  profile.  This  coincides  the 
theoretical  results  we  obtained  in  our  previous  works  [19,  20]  and  is  observed  in  the  simulation  results  in  the 
next  section.  r* 
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4  Simulation  Results 


In  this  section  we  show  some  simulation  results.  Unless  otherwise  stated,  the  parameters  used  are:  N  =  10, 
kp  =  1,  kv  =  1,  k  =  0.1,  kf  ~  0.1,  kr  =  10,  and  =  1.  The  sensor  profile  we  used  is  described  in 
Equation  (4)  with  c/o  =  1.00015,  cji  =  0.5,  and  c/2  =  8252.  The  noise  bounds  are  Dp  =  5,  —  5,  and 

Df  =  5.  For  simplicity,  instead  of  using  the  same  (non-plane)  profile,  we  assign  different  agents  different 
plane  resource  profiles,  with  their  gradients  represented  by  randomly  generated  numbers.  For  the  following 
simulation  runs,  the  norm  of  the  gradients  are  smaller  than  or  equal  to  R  —  159.  We  pick  6  =  0.47  and 

a  =  0.0472.  Then  by  solving  Equation  (25),  we  obtain  =  5.9  x  10^  and  =  4116,  which  specify 

the  size  of  the  set  and  the  upper  bound  of  ||£'*1|  for  all  i,  respectively,  as  stated  in  Theorem  1.  The 
positions  and  velocity  of  the  agents  are  initialized  randomly.  All  simulations  are  run  20  seconds. 

Figure  2  to  4  are  for  the  case  when  the  stability  condition  and  initial  condition  specified  by  the  theorem 
are  satisfied.  Figure  2  shows  that  the  agents  appear  to  move  around  erratically  at  the  beginning,  but  soon 
they  swarm  together  and  move  along  the  same  direction,  although  they  are  assigned  different  plane  resource 
profiles.  Due  to  the  effect  of  inter- ageiit  repulsion,  they  do  not  shrink  to  one  point  but  keep  certain  mutual 
spacing.  Prom  Figure  3  we  can  see  that  the  agents  have  quite  different  velocities  initially,  but  they  gradually 
catch  up  with  each  other.  Note  this  may  not  be  the  case  if  the  profiles  they  are  moving  along  are  not  plane 
profiles.  That  is,  if  we  use  some  complicated  profile  (with  “hills”  and  “valleys”),  then  their  velocity  may 
oscillate  and  will  not  always  be  the  same.  Figure  4  shows  how  the  norms  of  the  error  of  the  agents  changes 
as  time  goes  by. 


Swarm  agent  position  trajectones 


Figure  2:  Position  trajectories  of  the  agents  in  3d  space  (stable  case). 

If  we  keep  all  the  parameters  above  the  same  but  only  decrease  Cf2,  then  we  reduce  the  capability  of  the 
sensor  and  unstable  behaviors  of  the  system  are  observed.  Here  we  let  c/2  =  1500  and  Figure  5  shows  that 
the  swarm  splits  up  and  no  more  cohesiveness  is  achieved. 


5  Concluding  Remarks 

In  this  paper  we  derive  stability  conditions  under  which  social  foraging  swarms  with  limited  sensing  capa¬ 
bility  maintain  cohesiveness  when  following  certain  resource  profiles.  It  is  interesting  to  note  two  points. 
Firstly,  we  can  see  some  connection  between  the  limited  sensing  capability  and  changes  of  communication 
topology.  Specifically,  if  two  agents  are  close  to  each  other,  then  they  can  sense  each  other  well  and  thus, 
are  “connected.”  If  they  are  far  away,  then  each  agent  is  located  on  a  position  that  is  at  the  “low  end”  of 
the  sensor  profile  f{x)  of  the  other  agent.  Since  we  have  liiiix-^oo  f{x)  —  0,  then  they  are  “disconnected.” 
Apparently  this  change  from  being  “connected”  to  being  “disconnected”  may  be  regarded  as  a  change  in 
the  communication  topology.  Secondly,  by  comparing  this  paper  with  our  previous  work  [19,  20],  we  can 
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Swarm  velocities,  x  dimension 


\ 

- 

. 

C _ ^ ^ _ _  ..X  ,  .  -i . . . ^ ^ ^ _ I 

0  2  4  6  8  10  12  14  16  18  20 

Swarm  velocities,  y  dimension 
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Figure  3:  Vek)city  trajectories  of  the  agents  vs.  Time  (stable  case). 


Time, sec. 


Figure  4:  Norm  of  of  the  agents  vs.  Time  (stable  case). 


find  some  similarity  in  both  the  proof  of  the  theory  and  the  simulation  results.  This  implies  there  may  exist 
some  connection  between  the  limited  sensing  capability  and  a  noisy  environment /measurements.  Now,  if 
we  combine  the  two  points  mentioned  above,  it  would  be  interesting  for  us  to  think  about  the  following 
question:  Is  it  possible  to  draw  some  explicit  connection  between  the  two  seemingly  different  topics  of  noisy 
environment /measurements  and  changes  of  communication  topology?  If  we  could  do  so,  then  it  is  possible 
to  overcome  some  difficult  problems  on  one  topic  by  solving  the  “counterpart”  (but  possibly  easier)  problem 
in  the  other  topic. 
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